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We give asymptotic lower bounds of the value for Bruss' opti- 
mal stopping problem with multiple stopping chances. It interestingly 
consists of the asymptotic threshold values in the optimal multiple 
stopping strategy. Another interesting implication of the result is that 
the asymptotic value for each secretary problem with multiple stop- 
pings is in fact a typical lower bound in a much more general class of 
multiple stopping problems as modifications of odds problem. 

1. Introduction. We provide asymptotic lower bounds of probabil- 
ity of "win" (i.e., obtaining the last success) for odds problem with mul- 
tiple stoppings, which has some general setting in optimal stopping the- 
ory. The problem may be stated as follows. We observe sequentially a se- 
quence of independent 0/1 random variables, that is, Bernoulli sequence, 
Xi, X2, . . . , Xjsj, where is a given positive integer and the distribution is 
Pr[Xj = 1] = Pi, Pr[Aj = 0] = 1 — Pi = gj, < pj < 1 for each i. We say 
^^success" if Aj = 1 and ^^failure" if Xi = 0. We want to stop on the last 
success with multiple stopping chances. 

This is an attractive problem setting. We may quote from Bruss [6] : "Many 
stopping problems are of a similar kind. One often wants to stop on the 
very last success. For instance, investors are typically interested stopping 
on the last success in a given period, where a success is a price increase 
in a long position and a decrease in a short position. Similarly, venture 
capital investors often try to put all reserved capital in the last technological 
innovation in the targeted field. In secretary problems, we want to select the 
best candidate (which means stopping on the last record value) and so on." 

For single stopping problem, it has an elegant and simple optimal stopping 
strategy known as Odds theorem or Sum the Odds theorem. For the odds 
problem, a typical lower bound for an asymptotic optimal value (probability 
of win), when N goes to infinity, is shown to be 1/e in Bruss [6]. The value 
often appears in the literature of the many modifications of secretary prob- 
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lem having a specified probabihty of success, pi = [See, e.g., Pfeifer [18], 
Samuels [19] for a review and others.], and in the one of the variations of 
prophet inequality based on relative ranks, [See, e.g.. Hill and Krengel [16] 
and Hill and Kennedy [15].]. The value 1/e also appears in the asymptotic 
threshold value of the optimal stopping strategy for secretary problem. For 
large N, the optimal strategy is to pass the all candidate until (1/e) x and 
then stop at the first relative best (if any) thereafter. Another variations of 
odds problem are studied by Hsiau and Yang [17] for Markov-dependent tri- 
als with single stopping, Ano, Kakie and Miyoshi [2] for Markov-dependent 
trials with multiple stoppings, Tamaki [21] for stopping on any of the last 
m successes, and Bruss and Louchard [8] for unknown success probability. 

For each multiple stopping odds problem, the questions arise; (a) what 
is the optimal multiple stopping strategy to maximize the probability of 
win? (b) what is the maximum probability of win and the lower bound? (c) 
what is the asymptotic lower bound of probability of win for any sequence 
{pi,P2, . . . ,pn} the success probability and for any fixed number of stop- 
ping chances, when goes to infinity? (d) is the lower bound for each fixed 
number of stopping chances attained by the corresponding one of the secre- 
tary problem with multiple stopping chances? In other words, does secretary 
problem still keep benchmark position of the bound for odds problem? (f) if 
so, is the lower bound, strange to say, composed of the asymptotic threshold 
values in the optimal multiple stopping strategy? The first answer has been 
provided in Ano, Kakinuma and Miyoshi [3]. When the decision maker has 
more m stopping chances, there always exist threshold values satisfying in- 
equalities 1 < < < • • • < i^^) < N, and for each £ G {1, 2, . . . , m} 
the optimal stopping strategy is given by 

t(^) = min{i I i > max{i(^),r(^+^) + 1} and Xi = 1}, 

where t^^~^^^=0. The second and third questions are partially answered in 
also [3]. 

Let us summarize main results of this paper as follows. (1) We give the 
probability of win for odds problem with m-stoppings. (2) For any sequence 
{p1tP2, ■ ■ ■ , Pn} the success probability satisfying some conditions and for 
any fixed number m of stopping chances, we give the lower bound of prob- 
ability of win for odds problem with m-stoppings. An efficient algorithm to 
calculate lower bounds is presented. (3) We show that the asymptotic lower 
bound of probability of win for odds problem with m-stoppings is attained 
by the asymptotic maximum probability of win for secretary problem with 
m-stoppings. This answers the question (c). So that, the answer for (d) is 
"yes." (4) Finally, we show a beautiful connection between threshold val- 
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ues of optimal stopping strategy and probability of win. The asymptotic 
lower bound is composed of the asymptotic threshold values, ^\ 

. . . , if^}= . . . , i*'^-'}, in the optimal multiple stopping strategy, 

and given by 

m .(fe) 

(1.1) hm y ^ = lim 

k=l 

where P^™^ (m) denotes a corresponding probability of win for odds problem 
(and also for secretary problem) with m-stoppings. 

For example, when m = 1, it is well-known that the asymptotic threshold 
value is equals to the asymptotic probability of win. When m = 2, 
the asymptotic probability of win for odds problem is + e~^/^ that 
equal to the one for secretary problem. Optimal threshold strategy for 
odds problems with 2-stoppings is a threshold strategy, Corre- 
sponding asymptotic thresholds values are lim7v-i.oo(^7vV-^) = e~^/^ and 
limAr_^oo(^jvV-^) = e~^. These values are equals to the ones for secretary 
problem with 2-stoppings. When m = 3, asymptotic probability of win for 
odds problem is + e~^/^ + e~^^/^^. When m = 4, the corresponding one 
is + e 

-3/2 + g-47/24 + g-2761/1152 ^hat equals to the one for secretary 
problem. The connection between the probability of win and the threshold 
values remains in a similar way as the case of 2-stoppings. In secretary prob- 
lem, multiple stopping setting may go back to Gilbert and Hosteller [13]. 
Exact these values, e'^/^, ^^^^ g~276i/ii52 m = 1,2,3 and 4 

were founded in Bruss [5]. We give the values for m = 5, 6, 7, 8, 9 and 10 in 
Table 2. 

2. Win Probability of Threshold Strategy. Let Xi, X2, . . . , be 

a sequence of independent 0/1 random variables. For any i G {1, 2, . . . , A^}, 
we denote pi = E[Xj]. Throughout this paper, we assume that < pi < 1 

Pi 

for any i. We denote a probability of failure 1 — pi hy qi and an odds — of 
Xi by n. 

In this section, we introduce a threshold strategy for odds problem with 
m-stoppings defined on Xi, X2, . . . , Xjy. A threshold strategy is defined by 
a vector of integer threshold values i = . . . satisfying in- 

equalities 1 < < i^""-^) < • • • < < N. Simply put, a threshold 
strategy Threshold(i'^™'\ z^™"^^ , • • ■ , i^^^) observes a random variable at each 
iteration and selects a random variable of success if and only if the number 
of previously selected variables is less than the number of passed thresh- 
old values on and before the iteration. In the following, we give a precise 
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definition. A variable slack denotes a remained capacity for selection. The 
initial value of slack is equal to 0. At i-th iteration, we increase slack by 
|{A; € {1,2, ... ,m} | i = i^*^^}], which is the number of thresholds equal 
to i. When we select a random variable, we decrease slack by 1. If we have 
selected the last success before i-th iteration, we set result to win. Else, we 
set result to lose. When the value of result is win, variable last denotes 
the index of last success before the iteration. 



Threshold(i 



(m) -(m.-l) ■{l)^ 



Set Xj 



Step 0: Set i := 0; slack := 0; result:=lose; last := 0. 
Step 1: Set i := i + 1; slack := slack + \{k G {1, 2, . . . , m} | i = iC")}]. 
1 ( with probability pi), 
( with probability qi). 
Step 2: If [xi = 0], then goto Step 3. 
Else if [xi = 1 and slack > 0] 

then set slack := slack — 1; last := {i}; result:=win 
(and we say that index i is accepted). 
Else (both Xj = 1 and slack = hold), 
set last := 0; result:=lose 
(and we say that index i is rejected). 
Step 3: If [i< N], then goto Step 1. 

Else if [i = and result=win], then output the index in last and 
stop. 

Else output "lose" and stop. 

If the above procedure outputs an index i, then we obtained the last success 
attained by Aj. 

In the rest of this section, we discuss the probability of win of a threshold 
strategy Th.i:eshold{i^'"^\i^"^~^\ . . . If an index (corresponding to the 

last success) is obtained by executing Threshold(i), we say that a vector 
of realized values {xi,X2, . . . ,xn) S {0, 1}^ of (Ai, A2, . . . , A^r) is winning. 
We introduce a partition Bi, B2, ■ ■ ■ , Bm+i of index set {1,2,..., A} defined 
by 



B. 



' {z e {1, 2, . . . , AT} I < i < A} {k = 1), 
{i G {1, 2, . . . , A} I < i < i^^-i)} {l<k<m) 
{i G {1,2, ...,A} I 1 < i < i^'")} {k = m + l) 



N 



For any k, an index set Bj. is called a block. Given a 0-1 vector x € {0, 1} 
b{x) = {bm, bm-i, ■ ■ ■ ,bi) denotes an m-dimensional vector, called a pattern 
vector of x, satisfying bk = Yli^Bk^^ ^ (li 2, . . . , m}). Here we note 
that elements of vector h[x) are arranged in decreasing order of indices. 
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For any vector b = {bd, bd~i, • • • , 61), we say that a vector {bd',bd'-i, . . . , 61) 
satisfying d > d' > 1 is a left truncated subvector of b. Throughout this 
paper, Z_|_ denotes a set of non-negative integers. 

When we consider a single-stopping problem (discussed in [7]), a vector 
X € {0, 1}'^ is winning if and only if its pattern vector b{x) satisfies 61 = 1, 
i.e., one-dimensional vector (61) = (1) is a left truncated subvector of b{x). 
The probability of win of a threshold strategy Threshold(i(^)) is equal to 




Next, we consider that m = 2 (discussed in [3]). We assume that 

|i?i| > 2. It is easy to show that a vector x G {0,1}^ is winning if and 
only if its pattern vector b{x) has a left truncated subvector contained 
in a set {(1), (1, 0), (0, 2)}. Since every integer vector has at most one left 
truncated subvector in the set {(1), (1,0), (0,2)}, the probability of win of 
Threshold(i(^\ i^^)) is equal to 




+ 1 n * 




{i,i'}CBi 



Now we discuss a general case. First, we show a necessary and sufficient 
condition that a vector x G {0, 1}^ becomes a winning vector of m-stopping 
problem. We define a set of fe- vectors 



(bk,bk-i, ... ,61) € Z 



1 > bk, 

2 > bk + bk-i, 

k-l > bk + bk^i-\ h&2, 

k > bk + + • • • + 62 + 61 > 1 J 
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for each /c in {1, 2, ... , m}. The following lists give vectors in 



{(1)}, 

{(1,1), (1,0 

(1,1,1), 

(0,2,1), 
(0,0,3), 

(1,1,1,1 
(1,0,2,1 
(1,0,0,3 
(0,2,1,0 
(0,1,2,0 
(0,1,0,2 
(0,0,2,2 
(0,0,1,1 



,(0,2), (0,1)}, 

1,1,0), (1,0,2), (1,0,1), (1,0,0), 
0,2,0), (0,1, 2), (0,1,1), (0,1,0), 
0,0,2), (0,0,1) 



(1,1 


1, 


0), 


(1, 


1, 


0, 


2) 


,(1,1,0,1), (1,1, 0,0), 


(1,0 


2, 


0), 


(1, 


0, 


1, 


2) 


,(1,0,1,1), (1,0,1,0), 


(1,0 


0, 


2), 


(1, 


0, 


0, 


1) 


,(1,0, 0,0), (0,2,1,1), 


(0,2 


0, 


2), 


(0, 


2, 


0, 


1) 


,(0,2, 0,0), (0,1, 2,1), 


(0,1 


1, 


2), 


(0, 


1, 


1, 


1) 


,(0,1,1,0), (0,1, 0,3), 


(0,1 


0, 


1), 


(0, 


1, 


0, 


0) 


,(0,0,3,1), (0,0,3,0), 


(0,0 


2, 


1), 


(0, 


0, 


2, 


0) 


,(0,0,1, 3), (0,0,1, 2), 


(0,0,1,0), 


(0,0,0,4) 


,(0,0, 0,3), (0,0, 0,2), 



> . 



(0,0,0,1) 



Lemma 2.1. A vector x G {0,1}'^ is a winning vector of m-stopping 
problem if and only if there exists an integer k G {1,2,... ,m} satisfying 
that a pattern vector b{x) = {bm, bm-i, ■ ■ ■ ,bi) has a left truncated subvector 
{bk,bk-i, ■ ■ ■ ,bi) G Hfc. 

Proof. Assume that x G {0, l}'^ satisfies that whose pattern vector 
b{x) = {bm, bm-i, ■ ■ ■ ,bi) has a left truncated subvector in H^. Consider a 
case that we executed threshold strategy Threshold(i) and x was a vector of 
realized values of random variables {Xi,X2, . . . , X]\f). Condition b^ + + 
■ ■ ■ + bi > 1 in the definition of implies that there exists at least one 
index i with Xi = 1 satisfying i^^^ < i. Other conditions of implies that 
at every iteration later than or equal to i^*^^ of Threshold(i), every index i' 
satisfying Xj/ = 1 is accepted. Thus, Threshold(i) outputs the index of last 
success. From the above, x becomes a winning vector. 

Next, we discuss the inverse implication. Assume that a; is a winning vec- 
tor. Consider a case that a; is a vector of realized values of {Xi,X2, . . . , X^) 
obtained in procedure Threshold(i). From the assumption, Threshold(i) 
outputs the index of last success. If no index is rejected by Threshold(i), we 
obtain a desired result by setting k = m. Consider a case that Threshold(i) 
rejected at least one index. Let B/^/ be a block including rejected index and 
whose subscript is minimum. Since x is winning, block Bk' does not in- 
cludes the index of last success and thus k' > 2. Then includes a left 
truncated subvector of the pattern vector of a;. □ 
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For any k G {1, 2, . . . , m}, we define 
bk, . . . € Hfc 

The above lemma and the definition of directly implies the following. 



k>yk' > 1, V6' e Ek', 

b' is not a left truncated subvector of b 



Corollary 2.2. A vector x € {0, 1}^ is winning if and only if there 
exists a unique set (k G {1, 2, . . . , m}) including a left truncated subvector 
ofb{x). 

By a brute force method, we obtained that 



{(1)}, 

{(1,0),(0,2)}, 

{(1,0,0), (0,2,0), (0,1, 2), (0,0,3)}, 

(1, 0, 0, 0), (0, 2, 0, 0), (0, 1, 2, 0), (0, 1, 1, 2), (0, 1, 0, 3), 
(0,0, 3,0), (0,0, 2, 2), (0,0, 1,3), (0,0, 0,4) 

(1,0, 0, 0, 0)(0, 2, 0, 0, 0)(0, 1, 2, 0, 0)(0, 1, 1, 2, 0)(0, 1, 1, 1,2) 
(0, 1, 1,0, 3)(0, 1, 0, 3, 0)(0, 1,0, 2, 2)(0, 1, 0, 1, 3)(0, 1, 0, 0, 4) 
(0, 0, 3, 0, 0)(0, 0, 2, 2, 0)(0, 0, 2, 1, 2)(0, 0, 2, 0, 3)(0, 0, 1, 3, 0) > . 
(0, 0, 1, 2, 2)(0, 0, 1, 1, 3)(0, 0, 1,0, 4)(0, 0, 0, 4, 0)(0, 0, 0, 3, 2) 
(0,0,0,2,3)(0,0,0,1,4)(0,0,0,0,5) 



The following table of size of is obtained by a naive computer program 
for enumeration. 



■=1 
H4 



■=■5 



k 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 






1 


2 


4 


9 


23 


65 


197 


626 


2056 


6918 


23714 





Given an index subset B C {1,2,...,A^} and a positive integer b, we 
define that 



fiB) 



B'CB, \B'\=b \i&B' / 

(1^1 <^)- 



We also define /°(5) = 1. 

Corollary 2.2 directly implies the following theorem, which gives the prob- 
ability of win of a threshold strategy for odds problem with m-stoppings. 
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Theorem 2.3. Given a threshold strategy Threshold(i('"\ . . . jZ^^^-i^^)) 
for odds problem with m-stoppings defined on a sequence of 0/1 random 
variables Xi,X2, ■ ■ ■ ,^Ar, the corresponding probability of win is equal to 



k=l \ \iGBfcU-UB2UB1 / {bfe,...,fei)eHfc 

Proof. The definition of function f^{B) directly implies that for any 
non-negative vector (6^, 6^-1) ■■■ 1^1)1 



Pr 



>iGBfcU---UB2UBi 



n (fHBk)f'''-'{Bk^i)---f''HBi) 



From the uniqueness appearing in Corollary 2.2, the probability of win of a 
threshold strategy Threshold(i^'"^ , . . . ,i^^\i^^^) is equal to 



k=l (bfc,...,6i)GHfe 



E = h' (VA;' e{k,k-l,...,l}) 



= E n ^0 ^ 

fc=l \ \iGBfcU-UB2UBi / (bfe,...,6i)GHfc 

□ 

For example, when m = 3, the set S3 of winning patterns includes four 
vectors H3 = {(1, 0, 0), (0, 2, 0), (0, 1, 2), (0, 0, 3)} and thus the probability of 
win is equal to 



E--. + n * E'-.+ E 

/ E E ^»i^»2 

ieBs {ii,i2}CB2 



+1 n 

, jGB3UB2UBi 



\ \iGB2 / \{ii,i2}CSi 



r,:i r, 



11 ' «2 



+ E 

{*1,«2,«3}C-Bl 
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3. Mimic of Threshold Strategy. In this section, we introduce an 
artificial sequence of random variables, which gives a lower bound of the 
probability of win of an optimal strategy for odds problem with m-stoppings 
defined on Xi, X2, . . . , X^. We assume the following property. 

Assumption 1. For any i G {1,2,... ,N}, the probability of failure qi 
of Xi satisfies that < < 1 and In is a rational number. 

We can deal with that In qi is irrational (for an index i) by employing 

a sequence of rational numbers whose limiting value is equal to Ingj. 

Assumption 1 implies that there exists a large positive integer ry* satisfying 
that Vi € {1,2,... ,N}, 3£i G Z+, — Ing^ = ti/rj^. In the rest of this paper, 
we set 7/* to the minimum positive integer satisfying the above condition. 
We denote e~^^^* by for simplicity, i.e., we have 

Vi e {l,2,...,Ar}, 3^ieZ+, q^ = qi\ 

Obviously, inequalities < < 1 hold. 

Now we introduce a sequence of 0/1 random variables Yi^Y2, ■ ■ ■ sat- 
isfying L = h + I2 + ■ ■ ■ + £n and Vj € {1,2,..., L}, PT[Yj = 0] = 
(see Figure 1(a)). In this section, we show that any threshold strategy of 
Yi,Y2, . . . ,Yl for odds problem with m-stoppings satisfies that the corre- 
sponding probability of win is less than or equal to that of an optimal strat- 

pcrv nf ^Ti ^Tr, fnr nHHs nrnhlprQ with ?7l-stoppingS. 



-ln< 



-In q 2 -In g 3 -In g 4 -In q ^ -In 17 ( 





X2 


^3 


X4 




























































\ 











X, 



X, 



X, 



4 <l i 



X4 x^ 

A L 



X, 






1 








1 


1 

















1 








1 


























1 














1 











1 



y„ Y2, Y„ Y„ Y„ Y„. 



L,={Y^,Y2,Y„Y,},L2={Y„Y„...} 
(a) Random variables Yi,Y2, . . . ,Yl. (b) A joint distribution of Xi and Y\ 

Fig 1 . Mimic of threshold strategy. 



Given a sequence of indices j = ■ ■ ■ ,i^"^^) satisfying inequal- 

ities 1 < j^™-* < < • • • < j(^) < L, we also define a threshold strategy 

Threshold(j) oiYi,Y2, . . . ,Yl for odds problem with m-stoppings in a sim- 
ilar way with a threshold strategy defined in Section 2. In the rest of this 
section, we discuss the probability of win of Threshold(j). 

Given a threshold strategy Threshold(j) and an integer i S {1, 2, . . . , L}, 
we define a function (/)£ : {0, 1}^ — > {win, lose} as follows. For any £- 
dimensional 0-1 vector y € {0, 1}^, a function value 4'i{y) E {win, lose} 
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denotes the value of result obtained by executing Threshold (j) by us- 
ing y until ^-th iteration. It means that (j)i{y) is equal to win if and only 
if procedure Threshold(j) selects last success at the end of i-th iteration 
under the assumption that y € {0, 1}^ is a vector of realized values of 
Yi,Y2, . . . ,Y£. More precisely, the following deterministic procedure defines 
a function : {0, 1}^ — ?> {win, lose}. 

function (j)i{y) 

Step 0: Set j := 0; slack := 0; result:=lose. 

Step 1: Set j := j + 1; slack := slack + \{k € {1, 2, . . . , m} | j = 

Step 2: If [uj = 0], then goto Step 3. 

Else if [uj = 1 and slack > 0], 

then set slack := slack — 1; result:=win. 

Else (both yj = 1 and slack = hold), 

then set result:=lose. 
Step 3: If [j < i], then goto Step 1. 

Else, output the value of result and stop. 

In the following, we construct a specified strategy for odds problem with 
m-stoppings defined on Xi , X2 , • • • , X]\f which mimics a threshold strategy 
Threshold(j) defined on Yi,Y2, . . . ,Yl- A partition {Li, L2, ■ ■ ■ , Lj\f} (see 
Figure 1(a)) of index set {1,2,..., L} is defined by 



r {1,2,... ,4} (i = l), 



i'e{l,2,...,L} 



i"=i i"=i 



Assumption 1 implies that Vi G {1, 2, . . . , N}, \Li\ = £i > and qi"- = qi. We 
introduce a joint distribution of Xi and random variables {Yj \ j & Li} for 
each z G {1, 2, . . . , A^} satisfying that 

(ml) Fi[Xi =OAYj=0 (Vj € U)] = qi = qi' and 

Pr[Xi = 1 A = 1 (3i G Li)] = 1 - = 1 - % 
(m2) a marginal distribution of Xi satisfies Pr[Xj = 0] = g^, 
(m3) set of random variables {Yj \ j € Lj} is independent, identically 

distributed, and corresponding (marginal) distributions satisfy that 

Pr[y,- = 0] = (/* (VjeLi). 

The above condition implies that = if and only if Yj = 0, for all j € Li 
(see Figure 1(b) for example). A mimic strategy selects a random variable 
Xi if and only if [Xi = 1 and the threshold strategy Threshold(j) selects 
the last success in {Yj | j S Lj} at the end of (£1 + £2 + • • • + ^i)"th iteration] . 
A precise definition of our mimic strategy is as follows. 
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Set . - 



Mimic (j) 

Step 0: Set i := 0; result:=lose; last := 0; i := 0; y := (). 
Step 1: Set i := i + 1; ^ := ^ + £i. 

(with probability qi), 

1 (with probabihty 1 — Qi). 
Construct a 0-1 vector G {0, 1}^' as follows. 
If [xi = 0], we set = 0. 

Else {xi = 1), we choose a vector € {0, 1}^* \ {0} 

with probability qi'~'^{l - q*Y /{I - qi) where y = Y^j^Li Vj- 
Step 2: Set y := {y,y^) ; a vector obtained by concatenating y and y*. 

If [xi = 0], then goto Step 3. 

Else if [xi = 1 and (j)£{y) = win], 

then set last := {i}; result:=win. 

Else (both = 1 and (jjeiv) = lose hold), 

then set last := 0; result:=lose. 
Step 3: If [i< N], then goto Step 1. 

Else if [i = and result=win], then output the index in last and 

stop. 

Else output "lose" and stop. 

Since Mimic(j) is a stochastic procedure, we can deal with variables Xi 
and t/* defined at Step 1 as realizations of random variables. Let Xi be a 

random variable corresponding to a (realized) value Xi, and 1^ be a vector of 
random variables corresponding to a (realized) vector y*. It is obvious that 

PT[Xi = 0AY=O] = qi = qi' and Fr[Xj = I AY ^ 0] = 1 - qi = 1 - qi\ 
Clearly, random variable Xj satisfies Pr[Xj = 0] = qi and a vector of random 

variables Y satisfies 



Pr 







Pr[X, = 0] = qi = qi 



For each vector y € {0, 1}^' \ {0}, a vector of random variables Y satisfies 



Pr 



y 



Pr 



y 



X, = 1 



Pr 



X, = 1 



/r\i-q*)' 

1 - qi 



{l-qr) = q'r\l-q*y 



where y = X]jgi. Vj - From the above, it is easy to show that a set of random 
variables in Y is independent, identically distributed, and each random 
variable Yj in vector Y satisfies Pr[Y^' = 0] = q^, (Vj € Li). Procedure 
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Mimic(j) selects at most m indices in {1, 2, . . . , N}, and thus it is a strategy 
for odds problem with m-stoppings defined on Xi,X2, ■ ■ ■ ,Xi\[. If proce- 
dure Mimic(j) outputs an index, the obtained index corresponds to the last 
success in the vector of realized values {xi,X2, ■ ■ ■ ,xn)- A probability that 
Mimic(j) outputs an index is equal to a probability that vector of realized 
values y satisfies (piiu) = win, which is the probability of win of thresh- 
old strategy Threshold(j'). Consequently, the win probability of Mimic(j) 
is equal to that of Threshold(j). We have shown that the probability of 
win of an optimal strategy for odds problem with m-stoppings defined on 
Xi,X2, . . . ^Xn is greater than or equal to that of any threshold strategy 
Threshold(j) defined on Yi, 12, Yz,. From the above discussion, we have 
the following. 

Theorem 3.1. For any threshold strategy for odds problem with m- 
stoppings defined on Yi,Y2, . . . , Yl, the corresponding probability of win gives 
a lower bound of the probability of win of an optimal strategy for odds prob- 
lem with m-stoppings defined on Xi, X2, ■ ■ ■ , X]\f. 

We introduce a positive integer d and define a sequence of 0/1 random 
variables Yf,Y2, ■ ■ ■ ,YI^ satisfying Pr[l^- = 0] = ql^^. Then, we can show 
the following in a similar way with a discussion described above. 

Corollary 3.2. For any positive integer d, the probability of win of 
any threshold strategy for odds problem with m-stoppings on Yf, Y2, ■ ■ ■ , Y^ 
is less than or equal to that of an optimal strategy for odds problem with 
m-stoppings defined on Xi,X2, ■ ■ ■ ,Xn. 

Lastly, we show a lemma required in the next section. 

Lemma 3.3. If a sequence of 0/1 random variables Xi,X2, ■ ■ ■ ^X^ sat- 
isfies qiq2 ■ ■ ■ qN < , then there exists a positive integer d' satisfying that 
for any integer d > d' , the total sum of a common odds ri^^ = {l — ql^^)/ql^'^ 
of the sequence of random variables Yf, Y2, ■ ■ ■ , Y^ satisfies Lri^^ > A. 

Proof. Let A' be a value satisfying qiq2 - ■ ■ qN = . From the defini- 
tion of sequence Yf, Y2, ■ ■ ■ , Y^, it is easy to see that Pi[Yj^ = 0] = ql^'^ (Vj) 

and q^^'^ = qiq2 ■ ■ ■ qN = . By employing L'Hospital's rule, the total sum 
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of odds, denoted by Lri'^\ satisfies 

lim Lri^'' = lim L J^, — = lim ' ' ' ' ^ 



d— >oo d—^oo 

y* \ ^ ^ ^ \ y* / / 

> — -, lim d(l - q^:' ) = — Iim — — — 

— mq^d-^oo — in Q'^, d-i>oo 1/a 

= lim feili^ = A' lim .y"^ = A' > A. 

The above inequality directly implies the desired result. □ 

4. Lower Bounds. In this section, we discuss the probability of win 
of a threshold strategy for odds problem with m-stoppings defined on a 
sequence Yf,Y^,..., Yl introduced at the last of the previous section. 

Let (Ai, A2, • • • , Am) be a solution vector of an equality system; 

(fefc,...,bi)e=fc \ / 
For example, (Ai, A2, A3, A4) is a solution of the following equality system 

Ai =1, 

+ | =1. 

\ ^2 A^ A]^ 

^ 2! 1! 2! 1! 1! 2! 1! 3! 3! 2! 2! 1! 3! 4! 

By solving the above system, we obtain a solution vector (Ai, A2, A3, A4) = 
(1,1/2,11/24,505/1152). Now we show the uniqueness of a solution. The 
following property is discussed by Gilbert and Mosteller [13] in a setting of 
secretary problem. 

Lemma 4.1. For any k € {1,2,... ,m}, includes unit k-vector e = 
(1, 0, 0, . . . , 0) and every vector (6^, bk-i, . . . ,bi) € \ {e} satisfies bk = 0. 

Proof. From the definition of H^, it is obvious that e G H^. If a vector 
(6fc,6fc_i, . . . ,6i) G Hfc\{e} satisfies bk / 0, then bk = 1 and thus a left trun- 
cated subvector {bk-i, bk-2, ■ ■ ■ ,bi) is not a zero- vector and thus contained 
in Contradiction. □ 
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Table 1 

A unique solution of equality system (4--1)- 



Am 

r 

1/2 
11/24 
505/1152 
209519/491520 
49081919440723/117413668454400 
79517076913242599540918747743 
193003573558876719588311040000 

303495015 

32325460596234075302254005045179405811074379325249 

745007588 

12993473612938854416966977838930799571763200000000 

448130227964383523 
30571733950133653469533536772028676044366257300442 
16830303049161702172805176722865010900143806992001 

1110072612742364945 
47845493213273623476317581768829551455545915219181 
23315624957195621435513013513748480000000000000000 

987516406186022650657408069922343282 
66208397464700773072064685489356905227829381759871 
37865958009474867863488365496281731609636212281462 
96626577975959499051087663035777533766245278248706 
40096121718793868463613698993948155912740477984001 
2464522411121321065440235649497935699 
29104324006809890312129945082092425080632748539150 
55027199035483748007701106129537805807977992169375 
27132513498662936774805285136477456358447232852772 
52323755961404620800000000000000000000000000000000 



1 

0.5 

0.458333 
0.438368 
0.426267 
0.418026 

0.411998 



0.407372 



= 0.403695 



= 0.400693 



The above lemma says that the fc-th equahty of system (4.1) includes k 
variables A^, A^-i, • • • , Ai and is a linear equality with respect to A^. Thus, 
the equality system (4.1) has a unique solution. Table 1 shows a unique 
solution in cases that m < 10. 

We will show the following theorem in the next section. 

Theorem 4.2. For any positive integer m, equality system (4.1) has a 
unique solution (Ai, A2, . . . , Am) satisfying A^ > for every k. 

Now we show our lower bound. 

Theorem 4.3. Let (Ai, A2, . . . , Am) be a unique solution of equality sys- 
tem (4.1). If a sequence of 0/1 random variables Xi, X2, ■ ■ ■ , Xf^f satisfies 
YliLi 1i < ^~ ^''■^i '^'^ , then the probability of win of an optimal strategy for 



LOWER BOUNDS FOR BRUSS' ODDS PROBLEM 



15 



odds problem with m-stoppings defined on Xi, X2, ■ ■ ■ , is greater than or 
equal to 



k=l 



Proof. For any positive integer d, we introduce a sequence of 0/1 random 
variables Yf, Y-f, . . . , Y^ (defined at the last of previous section) satisfying 
that a probability of failure Pr[Yj^ = 0] = ql^'^ for each j € {1, 2, ... , L}. We 
denote a common odds (1 — qj'^^jqj'^ by rf^ . 

We introduce a specified threshold strategy Threshold(j^'"'*, ^\ • • • j 
j^^) for odds problem with m-stoppings on Yf^ Y2, ■ ■ ■ , Y^ defined by 

(4.2) = min{i g {1, 2, . . . , L} | Ai + A2 + • • • + Afe > (L - j)ri'''^}, 

for each k G {1,2, Theorem 4.2 implies inequalities 1 < j'^™^ < 

< • • • < j^^ < L and thus we can define a corresponding thresh- 
old strategy. Let {Bm.+i{d), Bm{d), . . . , Bi{d)} be a partition of index set 
{1,2,..., L} defined by 



Bk{d) 



{jG{l,2,...,L} Ij-y' <j<L} {k = l), 

{jG{l,2,...,L}|jf <j<jt"^)} (1<A;< 



m) 



[ {je{l,2,...,L}|l<i<if)} {k = m + l). 
First, we show that for any k € {1, 2, . . . , m}, 
(4.3) limri''^\Bk{d)\ = Xk. 

From the assumption Hi^i < e~^'==i'^'=. Lemma 3.3 implies that there 
exists a positive integer d' satisfying that for any integer d > d' , the length 
L satisfies L > YlT=i ^k/fi'^^ ■ When d is a sufficiently large positive integer, 
the size of block Bk{d) satisfies 

% + 2 > \Bk{d)\ > i| - 1 (Vfc G {1, 2, . . . , m}) 



and 



lim (Afc + 2rf^) > lim ri'^^|Bfc(d)j > lim (Afc - rl'^^) 

d— >-oo d— foo d— >oo 

Ad) I 



Xk> lim rr|Sfc((i)| >Xk, 
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since the common odds r'f^ = (1 — qj'^^jqj'^ > satisfies limd_j.oo ri^^ = 0. 
From the above, we obtain (4.3). 

Next, we show that 
(4.4) 

\b 



hm TT q'J'^ = e-^" and V6 G {0, 1, . . . , ?n}, hm f{Bk{d)) = -f , 

iGBfc{d) 



for each A; € {1, 2, . . . , m}. It is easy to see that 



hm TT ql^'^ = lim ql^''^'^^^/'^ 
jeBk{d) 




Hm I I ^ I I = e-^^ 



When 6 = 0, the definition of f{Bk{d)) says that f{Bk{d)) = 1 - ^ 



0! 

holds permanently. Theorem 4.2 and (4.3) say that a limiting value of 
\\m.d-^^r^\B}^{d)\ is a positive constant A^. Since the common odds sat- 
isfies limrf_>.oo ri'^^ = 0, it is clear that limrf_>.oo \Bk{d)\ = +oo. When d is a 
sufficiently large integer, the size of block Bk{d) is greater than m and the 
definition of f^{Bk{d)) implies 

V6 G {1,2, . . . ,m}, hm f\Bk{d)) = lim ( l^^^^^^' ) (ri^^- 

It is easy to see that 



hm ^^^(,1'^))^ > lim (rl'^Y > lim ^'"^^7 ~ ^ (r-^T 

d^oo 6! d->oo \ / "^^oo ^' 



d— >-oo b\ d^oo y b J d-J-oo 6! 



> lim {rrr> 



bf R, — A 



From the above, we obtain that lim^_j.oo f {Bk{d)) 

Now, we show our lower bound. As shown in Corollary 3.2, for any positive 
integer d, the probability of win of any threshold strategy for odds problem 
with m-stoppings defined on 1^^, l^*^, . . . , gives a lower bound of that 
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defined on Xi,X2, ■ ■ ■ ,Xi\f. The above discussions directly imply that the 
win probability of Threshold(j^™\ j^™ ^\ ■ ■ ■ dji^) gives a lower bound 




(fefe,...,6i)eHfe 



k=\ \ \k'=i / \(bi.,....b,)eSi. « ^ / / k=i 



where the last equality is obtained from (4.1). □ 
The above theorem says that; when m = 3,4, 5, our lower bounds are 

47 3 -, ^ , 2761 47 3 -, 

e-24+e-2+e-^ > 0.7321029820, e'TiM +e-24 +€'2 +6'^ > 0.8231206726, 

4162637 2761 _47 _3 _-, 

and e 1474560 + e 1152 + e24+e2+e > 0.8825499145, respectively. 
Tables 2 and 3 show our lower bounds in cases m < 10. 

In the next section, we propose an efficient method for calculating a unique 
solution (Ai, A2, . . . , Am) of (4.1) without enumerating vectors in Ek {k € 
{1,2,... ,m}). 

5. Calculating Lower Bounds Efficiently. In this section, we de- 
scribe a proof of Theorem 4.2. Our proof naturally induces an efficient tech- 
nique for calculating our lower bounds. 

First, we introduce a directed graph, which plays an important role in our 
proof of Theorem 4.2. Let Gm be a directed graph with vertex set 

V = {{k, k') eZl\0<k<k' <m} 

and directed edge set 

E = {{v,v) € I 3{k,k',k"),v = {k + l,k'),v = {k,k"),k' > k"}. 

Figure 2 shows directed graph G5. 

For any path of length k (where k € {1, 2, . . . , m}) on Gm starting from 
vertex (k, k) defined by a sequence of vertices 

((/c,Cfc), (/c - l,Cfc_i), . . . , (l,ci), (0,co)) where {k,Ck) = {k,k), 

we associate a non- negative vector b = (6^, . . . , 61) satisfying bk' = 
Ck' — Ck'~i {k' € {k, A; — 1, ... , 1}). The above definition directly implies that 
V/c' G {k,k - I,..., 1}, Ck'-i = k - {bk + bk-i + • • • + bk'). Figure 3 (a) 
shows a path corresponding to vector (64, 63, 62, ^i) = (0,2,0,1). When a 
sequence of vertices ((/c, k),{k — 1, Cfe_i), . . . , (1, ci), (0, cq)) forms a path on 
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Table 2 

Cumulative sum of entries in (Ai, A2, . . . , Am)- 



1 

3/2 
47/24 
2761/1152 
4162637/1474560 
380537052235603/117413668454400 

705040594914523588948186792543 
19300357355887671958831 1040000 
3025002101 

77484374840641189918370275991590974715547528765249 

745007588 

12993473612938854416966977838930799571763200000000 

4955429267826902943 
22991702889058732983678465397265103848504031927299 
12522937262239403638817695466470734534217406992001 

1110072612742364945 
47845493213273623476317581768829551455545915219181 
23315624957195621435513013513748480000000000000000 

11989289035379212035246168789525873032 
80849078486814692748999764352069320540924554366342 
20167531781129657310860185112917637526070528528590 
30333616681207477435841890935057636581590554638168 
66245450807944253110095088765765115912740477984001 

2464522411121321065440235649497935699 
29104324006809890312129945082092425080632748539150 
55027199035483748007701106129537805807977992169375 
27132513498662936774805285136477456358447232852772 
52323755961404620800000000000000000000000000000000 



= 1 

= 1.5 

= 1.958333 

= 2.396701 

= 2.822969 

= 3.240994 

= 3.652992 



= 4.060364 



4.464059 



= 4.864751 
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Table 3 
Lower bounds. 



m 






fe=i 


1 


0.3678794411 


2 


0.5910096013 


3 


0.7321029820 


4 


0.8231206726 


5 


0.8825499145 


6 


0.9216748810 


7 


0.9475883491 


8 


0.9648310882 


9 


0.9763466188 


10 


0.9840603638 




Fig 2 . Directed graph G5 . 
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Gm, then k' — 1 < Ck'~i for all k' G {k, k — 1, . . . , 1}, which implies that 
(bk + bk-i + • • • + &fe') = k — Cfe/_i < k — k' + 1. It is easy to see that a 
non-negative vector b = {bk,bk-i, . . . ,bi) corresponds to a path of length k 
on Gm starting from vertex (k, k) if and only if b satisfies 

bk + bk-i + --- + bk' + k' <k + l (/c > V/c' > 1). 

Let us recall the definition of Ek, i.e., 



(6fc,6fc-i,...,fei) e Zl 



Zi=k' be + k' <k + l {k> W > 1), 
Ell bi > 1 



The above definition implies that a non- negative vector b = {bk,bk-i, . . . ,bi) 
corresponds to a path of length k on Gm. starting from vertex {k, k) if and 
only if either 6 G H^. or 6 = 0. 

-,(@)4j|^(@)f'V''i^'il5) ^€3) ^€5> ^€5) =i<£!iS ^(@> 



(j5|j)-:----->(@)-''----->(53;§)--------> ^arsp ^dos)) (j53])*-^(j4jj'^->@) >@) ^(jrii) '((gD 

/ N T-v- i J -ti J- i (b) Directed path correspondine to 

(a) Directed path corresponding to ) ' ^ ° 

(64,63,62,61) = (0,2,0,1). (65,64,63,62,61) = (0,1,2,0,0) G Hs with 

index k* = 3. 

Fig 3. Directed paths corresponding to non-negative vectors. 



Next lemma characterizes paths corresponding to vectors in C 



Lemma 5.1. For any integer k S {1,2, ... ,m}, a non-negative vector 
b = (bk, bk-i, . . . ,bi) is contained in if and only if there exists a unique 
index k* € {A;, A; — 1, . . . , 1} satisfying 

(cl) bk + 6fc_i + --- + bk> + k' <k + l {k>yk' > k*), 

(c2) bk + bk-i + --- + bk* +k* = k + l, 

(c3) bk + bk-i + --- + bk' + k' <k + l {k* >yk' > 1), and 

(c4) bk*-i = fcfc._2 = • • • = 61 = 0. 

Before proving the above lemma, we consider an example (65, 64, 63, 62, 61) = 
(0,1,2,0,0) G H5. In this case, by setting k* = 3, property (c2) holds, be- 
cause 65 + 64 + 63 + A* = + 1 + 2 -|- 3 = 6 = A; + 1. It is easy to see that 
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other properties are also satisfied. Figure 3 (b) shows a corresponding path 
on G5. 

Property (c2) says that a path on corresponding to & S passes 
vertex (k* — l,k* — 1) (see Figure 4 (a)), since 

Cfe._i = k-{bk + 6fc_i + --- + bk*) = k-{k+l-k*) = k* -1. 

Combining properties (cl), (c2) and (c3), we can say that a specified set of 
vertices {(0, 0), (1, 1), . . . , {k, k)} includes exactly two vertices {{k, k), {k* — 
— 1)} in the path. From property (c4), a left truncated subvector 
6fc*-2, ■ ■ ■ ibi) becomes the zero-vector, which corresponds to a sub- 
path from (/c* — 1, k* — 1) to (0, A;* — 1) forming a horizontal line in Figure 4 (a). 




Fig 4. Directed paths on G, 



Proof. (Proof of Lemma 5.1.) Let b = (6^, 6fc_i, . . . , 61) be a vector in 
Sfc. Since C H^, vector b is also an element of S^. 

Assume on the contrary that every k' € {/c, k — 1, . . . , 1} satisfies strict 
inequality 'Yl^=k' bi + k' < k + 1. By setting k' to k, we obtain bk + k < k + 1 
and thus bk = 0. It implies that for any k' S {k — l,k — 2,...,l}, inequalities 
J2eZk' be + k' = J2e=k' bi + k' < k + 1 hold. A left truncated subvector 
(6fc_i,6fc_2, ... ,61) of ft satisfies 

k-l 

^^be + k' <{k-l) + l {k-l>yk' >1). 
e=k' 

Since 6 G H^, we have that 1 < Yle=ibe = ^e=ibe- Accordingly, a left 
truncated subvector {bk-i, . . . , 61) is contained in E^-i, and thus b ^ H^. It 
is a contradiction. 
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From the above, there exists at least one index k' satisfying the equality 
X]^=fc' b£ + k' = k + 1. We set k* € {k, /c — 1, . . . , 1} to the maximum (i.e., 
leftmost) index of (6^, . . . , 6i) satisfying Yle=k* + = k + 1, which 
directly implies properties (cl) and (c2). 

Next, we show property (c4). Property (c2) implies that k* — 1 > \tk' > 1, 

k*-l k k k 

^^be + k' = - ^ h + k' = - + - k*) + k' 

e=k' t=k' e=k* e=k' 

< {k + l)-{k + l-k*) = k* = {k* + 

If 6fe*_i+6fc._2+- • -+61 > 0, then aleft truncated subvector {bk*-i, bk*-2, ■ ■ ■ , 
bi) is contained in which implies b H^. It is a contradiction. We 

have shown + bk*~2 + • • • + 61 = and (c4). Property (c3) is obtained 
directly from (c4). 

Next, we discuss the inverse implication that a non- negative vector b = 
. . . , 61) satisfies (cl)-(c4). Property (c2) directly implies 6 7^ 
and b € Sfc. Assume on the contrary that b ^ 'Ei^. Then there exists an 
index k' € {k — l,k — 2, . . . ,1} satisfying that a left truncated subvector 

= {by ibk' -i, ■ ■ ■ ibi) is contained in H^/. Since b' / 0, property (c4) 
implies k > k' > k* and equivalently k > k' + 1 > k* . From property (cl), 
an inequality 

bk + bk-i + ■■■ + bk'+i + {k' + 1) <k + l 

is obtained directly. Then, we have that 

bk' + bk'-i H \-bk* +k* 

= {bk + bk-i H h 6fc*) - {bk + H h bk'-i) + k* 

> {k + l-k*)-{k + l) + {k' + l) + k* = k' + 1, 

which contradicts with the assumption b' G H^/. □ 
For any k G {1, 2, . . . , m}, we introduce 

^fc = |(fcfe,bfc-i, ■ ■ ■ ,bi) eEk\bk + bk^i H h 62 + fti = ^1 • 

It is clear that is a set of vectors corresponding to paths on Gm from 
vertex {k,k) to (0,0). For any vector b € H^, the corresponding path 
{{k, k), {k - l,Cfc_i), . . . , (l,ci), (0,co)) (where (0,co) = (0,0)) has a unique 
index k* G {k,k — 1,...,!}, called the first apex (see Figure 4(b)), sat- 
isfying (1) Cfc*_i = k* — 1 (the path passes vertex (A;* — l,k* — 1)) and 
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(2) k > VA;' > A;*, Ck' > k' (the path does not include any vertex in 
{{k — l,k — l),{k — 2,k — 2), . . . , {k*,k*)}). We can partition the set of 
vectors in depending on their first apexes. Let H^(/c*) be a set of vectors 
in whose first apexes are k*. For any vector {bk, bk-i, . . . ,bi) € H^(/c*), 
Lemma 5.1 imphes that {bk,bk~i, . . . , , 0, 0, . . . , 0) G Z^^ is contained in 
Hfc and the definition of imphes 6fc*_2, . . . , fei) € 

We introduce a weight w{e) of an edge e = ((/c+l, A:'), (A;, A;")) S E, defined 
by w{e) = /{k' — k")\ where (Ai, A2, • • • , Am) is a unique solution 

of (4.1). For each directed path on Gm, we define that a weight of the path 
is equal to the product of weights of all the edges in the path. It is easy to see 
that, for any vector (6^, 6^-1) •••,&!) £ ^fci the weight of the corresponding 
path is equal to 

\bk .bi \ 

bkl bk-il bi\ J ■ 

Especially, a zero- vector induces a path forming a horizontal line in Figure 2, 
whose weight is equal to 1. Equality system (4.1) implies that the sum of 
weights of paths corresponding to vectors in is equal to 1. 

For any vertex (A;, k') € y\{(0, 0)}, j{k, k') denotes the sum of the weights 
of directed paths on Gm from vertex {k,k') to (0,0). We define 7(0,0) = 1. 
The following lemma plays an important role for proving Theorem 4.2. 

Lemma 5.2. Let (Ai, A2, . . . , Am) be a unique solution of equality sys- 
tem (4.1). Then, for any k G {1, 2, . . . , m}, the sum of weights of paths from 
{k,k) to (0,0) on Gm, denoted by^{k,k), is equal to 1. 

Proof. The definition of directly implies 

^ ,U,!6,_i! b^l ■ 

(bfc,...,fei)GH+ \ / 

We show 'y{k, A:) = 1 by induction on k. 

When A: = 1, Ef = {(1)} and Ai = 1, and thus we have a desired result. 
Assume that for every A:'e{l,2,...,A; — 1}, equality 

{V,...,bi)es+ \ / 

holds. For each k* G {A;, A; — 1, ... , 1}, H^(A;*) denotes a set of vectors in 
whose first apexes are k* . Similarly, we define that for any index k* € {A:, k — 
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1, . . . , 1}, Hfc(A:*) is a set of vectors in which have k* as a unique index sat- 
isfying properties (cl)-(c4) in Lemma 5.1. As discussed above, every vector 
(bk,bk-i, ...,bi) G satisfies that (6^,6^-1, . . . , , 0, 0, . . . , 0) G 

is contained in Ek{k*) and bk*-2, ■ ■ ■ ,bi) £ Conversely, for any 

pair of vectors (&, b) G Hfc(A;*) x it is easy to see that 

{bk,bk-i, . . • ,fefc*,6fc*-i,6fe*-2 • • • ,bi) G 
The induction hypothesis and Lemma 5.1 imphes 



(fefe,...,fei)GH+ 

k 



A 



bi 



bil 



bkl bk^il 



k* = l 



(fefe,...,6i)eH+(fe*) 



6i! 




E 



\{6,._i,...,6i)eH+_^ 

7(fc* - 1,A;* - 1) 



fc*=l(fefe,...,6i)GSfe(fc*) 



(bfe,...,6i)GSfc 



A. A 



bk^. 



1, 



0! 



bi\ 



where we define that if /c* = 1, then the fohowing equahty 



E 



Ail 
bi\ 



7(0,0) = 1 



holds for simplicity, and the last equality is obtained from (4.1). 



A^ 
bi\ 



□ 
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Now we show a property, which directly induces Theorem 4.2. 

Theorem 5.3. Let (Ai, A2, • • • , Am) be a unique solution 0/ (4.1). For 
any G {1, 2, . . . , m}, Afc > and 1 = 7(/c, k) > j{k, k + 1) > ■ ■ ■ > ^{k, m). 

Proof. (Proof of Theorem 5.3 and Theorem 4.2.) 

We show Theorem 5.3 by induction on k. When /c = 1, it is obvious, 
because 7(1, fc) = Xi/kl and Ai = 1. 

Assume that 1 = ^{k — l,k — 1) > ^{k — l,k) > ••• > 7(/c — l,m). 
Lemma 5.2 directly implies 

1 = 7(fc, k) = ^j{k -l,k-l) + ^j{k -l,k) = Xk+ j{k - 1, k). 
The induction hypothesis induces that 

(5.1) Afc = 1 - 7(A; - 1, k) = 7(/c - 1, /c - 1) - 7(/c - 1, A;) > 0. 

In the rest of this proof, we denote A^/6! by w{b) and 'y{k — 1, A;') by ^'{k') 
for simplicity. From Lemma 5.2, equality ^'[k — 1) = 1 holds. For any k' G 
{k, /e + 1, . . . , m — 1}, the induction hypothesis implies 

-i{k,k')--i{k,k' + 1) 

= w{<d)-f'{k') + w{l)-f'{k' - 1) + • • • + w{k' -k + l)-i'{k - 1) 

w{<d)i{k' + 1) + w{l)-i'{k') + ■■■ + w{k' -k + l)i{k) 
+w{k' - k + 2)i {k - I) 

= u;(0) (7'(fc') - -i'{k' + 1)) + w{l) (^^{k' - 1) - 7'(feO) + • • • 

• • • + w{k' - k) (j'{k) - j'{k + 1)) + w{k' -k + 1) (^j'{k - 1) - j'{k) 
-wik' -k + 2)j'{k-l) 
> w{k' -k + 1) (^j'{k - 1) - j'{k)^ - w{k' -k + 2)-f'{k - 1) 

= w{k' -k + l)(l- 7(/c - 1, k)^ - w{k' -k + 2) 

= w{k' -k + l)Afc - w{k' - k + 2) (obtained from (5.1)) 

= w{k'-k + l)(\k 



w{k' - k + 1)A, (1 - ^ 



k' -k + 2, 

> 0. 



k + 2 

Here we note that the strict inequalities appearing above are obtained by 
the positivity of A^. □ 
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The above proof directly induces a dynamic programming technique for 
calculating (Ai, A2, • • • , Am) efficiently. As shown in (5.1), we can calculate 
Afc by 1 — j{k — l,k). Thus, we only need to calculate j{k, k') for each vertex 
{k,k') G V sequentially as follows. 

Algorithm A 

Step 0: Set k := 1; Ai := 1; j{l,k') := l/k'\ for all k' € {1,2, ...,m}. 
Step 1: Set k := k + 1; 7(/c, k) := 1; A^ := 1 - -f{k - 1, k). 

For each k' £ {k + I, . . . , m}, set ^{k, k') := ^ ^ h\\ ^^^ ~ 

c=k 

Step 2: If k = m, then stop and output (Ai, A2, • • • , A^)- Else, goto Step 1. 

We can calculate a weight - — ^ in Step 1 efficiently by using recurrence 

(c — ky. 

^c— fc /A \ X'^~^~^ 

relation - — ^ = ( — I - — — — . Then, the total number of basic 

[c — k)\ \c — kj {c — k — l)\ 

arithmetic operations required in Algorithm A is bounded by O(m^). 

At the last of this section, we discuss a relation between our lower bounds 

and Poisson distributions defined by (Ai, A2, • • • , Am)- We introduce a Markov 

chain defined on a state space 

= {{k, k') I A; € {0, 1, ... , m} and k' e {m, m - 1, . . . , 0, -1, ...}}. 

For any pair of states v,v' S il, we define a transition probability 

)k'-k" 

^ ( if 3{k, k', k"),v = {k + 1, k'),v' = {k, k") and k' > k"), 



{k' - k")\ 

(otherwise). 

If we set (Ai, A2, . . . , Am) to a unique solution of (4.1), the fc-th term e~^fc'=i 
of our lower bound is equal to the probability of sample path ((/c, k),{k — 
l,k),{k — 2,k), . . . ,{0,k)), which corresponds to path forming a horizontal 
line in Figure 2. Lemma 5.2 implies that for any k € {1, 2, , . . . , m} 

^ ^ \ hi bk-il 61! i 

The above equality says that the k-th term of our lower bound is also equal 
to the total sum of probabilities of sample paths 

{{k, k),{k- 1, Ck-i), {k - 2, Ck-2), . . . , (1, ci), (0, 0)) 

satisfying that Ck' > k' for all k' e {k — 1, k — 2, . . . , 1}. 
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6. Tightness of Lower Bounds. In this section, we show the tightness 
of our lower bounds obtained in Theorem 4.3. For any positive r > 0, we 
introduce a sequence of 0/1 random variables XI, X2, ■ ■ ■ , X'^ satisfying 
Pr[X[' = 0] = g = 1/(1 + r) (V« € {1, 2, . . . , A^}), where r is called a common 
odds. Ano, Kakinuma, and Miyoshi [3] showed that an optimal strategy 
for odds problem with m-stoppings is attained by a threshold strategy. We 
denote an optimal threshold strategy for odds problem with m-stoppings 
on Xl,X2, ■ ■ ■ ,XJ^ by Threshold(zr'"\ i^"* ^\ ■ ■ ■ ,^r^'*), which is dependent 
on common odds r. A partition {Bm+i{r), Bm{r), ■ ■ ■ , Bi{r)} of index set 
{1,2,...,N} is defined by 



Bk{r) 



{i G {1,2,... ,iV} I 4.^^ < i < iV} {k = l) 



{iG{l,2,...,iV} <i<4'' {l<k<m), 
{i G {1,2,... ,iV} I 1 < i < 4""^} {k = m + l). 

We show a lemma, which is a building block of our proof of tightness. 

Lemma 6.1. Let (Ai, A2, . . . , A^) be a vector consisting of all positive en- 
tries. Assume that a threshold strategy Threshold(2r™\ ^\ ■ ■ ■ ,i^^) dnd 
a corresponding partition {Bm.+i{r), Bm{r), . . . , i?i(r)} satisfy a condition 

(6.1) lim r\Bk{r)\ = Xk, 

for each k G {1,2, . . . ,m}. Then the partition also satisfies 

\b 

(6.2) lim gl^'-'WI = 6-^'= and V6 G {0, 1, . . . , m}, lim f\B J r)) = 
for each G {1, 2, . . . , m}. 

Proof. It obvious that for any G {1, 2, . . . , m}, 

l/^^x r|i3fe{r)| 

lim = lim ( ( — ^ ] = e"^''. 




When 6 = 0, the definition of /°(Sfc(r)) says that /°(Sfc(r)) = 1 
holds permanently. Next, we consider cases b G {1, 2, 3, . . . , m}. Since a 
limiting value limr_i.+o ^|-Bfc(r)| is a positive constant Afc, it is clear that 
limj._j.+o l^fc(^)l = +00. There exists a sufficiently small positive number r' 
such that < V?' < r', the size of Bk{r) exceeds m, and thus 

Mm f\Bk{r))= lim ( l^^^'^)' \ r' (V6 G {1, 2, . . . , m}). 
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It is easy to see that 



b\ r-s-+0 V ^ / r-5-+0 b\ 

# < lim l^'C-'l ) < |. 
b\ ~ \ b I ~ bl 



b 



Thus, we have shown liuir^^o f {Bf^{r)) = □ 
Now we show the tightness of our lower bound. 

Theorem 6.2. Let (Ai, A2, . . . , Am) be a unique solution o/(4.1). For any 
positive r > 0, we introduce a sequence of random variables X[, , . . . , X"^ 
with a common odds r > satisfying q^ < e~^k=i^k yjhere q = 1/(1 + r). 
A probability of win P^"'"'' (m) of an optimal strategy for odds problem with 
m-stoppings defined on the sequence XI, X2, ■ ■ ■ jX"^ satisfies 

m 

lim P("'")(m) = y^e-^^'=i^fe'. 

k=l 

Proof. First, we discuss the length of a given sequence. Let A' be 
a positive number satisfying q^ = e~^ . By employing L'Hospital's rule, 
assumption q = e < e ^fc implies 

(6.3) 

-A'r A'r ^ 
lim Nr = lim = lim - — = lim A'(l + r) = A' > > At'. 

r^+O r^+O Inq r-i>+0 ln(l + r) r->+0 

Ano, Kakinuma, and Miyoshi [3] showed that an optimal strategy for odds 
problem with m-stoppings on X[, XJ, . . . , X]^ is attained by an optimal 
threshold strategy Threshold(z^™\ i^"^ ^\...,i!}^^) satisfying that for any 
index k G {1,2, ... ,m}, Threshold(zl'^\ ir'^ ^\...,ii^^) is also an optimal 
strategy for /c-stopping problem. 

In the following, we show (6.1) in Lemma 6.1 (and (6.2), simultaneously) 
by induction on k. When k = 1, Threshold(ir^^) is optimal to single-stopping 
problem. Prom property (6.3), the sum total of odds Nr > Ai = 1, when 
r is a sufficiently small positive. Bruss' Sum the Odds Theorem implies 
1 — r < r\Bi{r)\ < 1 + r. Accordingly, we have 

lim (1 — r) < lim r|i3i(r)| < lim (1 + r) 

r->+0 r~¥+0 

1 < lim r\Bi(r)\ < 1, 

r->-+0 
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and lim r\Bi(r)\ = 1 = Ai. Lemma 6.1 implies that V5 € {0, 1,2, .. . ,m}, 

lim,^+o/'(i?i(r)) = f . 

Now we describe k-th. induction step (where k < m) under the assumption 
that for any fc' G {1, 2, . . . , fc — 1}, 
(6.4) 

hm r\Bk,{r)\ = A,, and V6 G {0, 1, 2, . . . ,m}, lim f{Bj,,{r)) = 

Let e be a unit fc-vector (1,0,0,... ,0). Lemma 4.1 says that e € and 
every vector (6^, ■ ■ ■ € Ek \ {e} satisfies 6^ = 0. Thus, we have 

(6fc,...,f)i)eSfc 

= r\Bu{r)\+ J2 {f''-'{Bu-i{r))f''-^{Bu-2{r))---f'{B,{r))) 
(6fc,...,6i)eSfc\{e} 

The induction hypothesis (6.4) and equality system (4.1) imply 



(6-5) ^HmJ E (r-UBfc-i(0)/'""-ni?fe-2(r))---/''Ui?i(r))) 



E 

(bfe,...,6i)G3fc\{e} 



E 

(bfc,...,6i)e3A{e} 



E 

(bfc,...,fei)eHfc 

1-Afc. 



0! 5fc_2! foi! ; 

Ah^A^J A^\ _ /A[At, At, A?^ 
6fc! 6fc_i! 6fc-2! 6i! i l 1! 0! 0! 0! 



Now we employ a one-stage look-ahead approach [1] to complete A;-th 
induction step. For each index i satisfying 1 < i < ^\ we introduce a 
threshold strategy Threshold(i, ^\ir' ■ ■ ■ ^^r^) for /c-stopping prob- 
lem. We denote a corresponding probability of win by P^'''^(A:,i). A differ- 
ence of win probabilities of threshold strategies Threshold(i — . . , 
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ii^^) and Threshold(i, i}.'*' ^' , . . . , ir''') satisfies 
p(""^)(A;,i- 1) -P("''^)(A:,i) 



Vi'=j / \ (bfc,....bi)es&\{e} 

(ir-*^ — i + l)gr — (z^'^ — i)r ^ 

+(9-1) E [f--'{B^-,[r))---f'{B,{r))) 

\ (b&,....bi)eHA{e} / 

/ [i^r — — 1) + ^ 

+ E (/^-^(Sfc-iW)---/''^(Bi(r))) 

\ (bfc,....bi)eHfc\{e} / 



(bfc,...,bi)eHfc\{e} 



From the above, it is easy to see that V^^'''^\k, i - 1) - P^'°)(A;, i) is strictly 
increasing with i and thus a sequence of win probabihties 

(P^^''^) (fc, 1) , P(™) (A:, 2) , . . . , P(™) (A;, if"^'^)) 



is unimodal. Let us consider a pair P^'")(fc,4'^-')-l) and Pr"^(A:,i 



Equality (6.5) implies 



lim 

r->+0 



V 



E (/''-Hi?fc-i(0)---/''ni?i(0)) 

(&fc,...,6i)GSfc\{e} 



.l™ol^" 51 (/-ni?fc-i(^))---/''USi(0)) 
''^ (bfc,...,6i)es&\{e} 

= l-(l-Afc) = Afc>0, 
and thus there exists a positive r' satisfying 

(6.6) < Vr < r', p(^*'^)(A:, 4'="^) - 1) - p("''^)(A:, i,(A;)) > 0. 
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Next, we consider a pair p'r^'^Hk, 2) and P^'''^(fc, 3). When r is a sufficiently 
small positive, property (6.3) implies Nr > J2T'=i ^k' and 

AT = 4^-i)-l + |i?,_i(r)| + |i3,„2(r)| + --- + |i?i(r)| 
3-4^=-!) = 2-N +\Bk^i{r)\ + \Bk^2{r)\ + --- + \Bi{r)\ 



lim 3-#-^hr = lim \2r - Nr +^ r\Bk 

\ k'=l / 

/ m k—1 



k'=l k'=l 
k-1 



fc'=l k'=l k'=k 

where the penultimate equality is obtained from the induction hypothe- 
sis (6.4). Accordingly, we have 

J2 {f''-HBk-i{r))---f'>HB^ir))) 



lim 



V 



(bfc,...,6i)GHA{e} 



V k'=k / k'=k 

and thus there exists a positive r" satisfying 

(6.7) 0<Vr<r", p(™''^)(A:, 2) - p(™''^)(A;, 3) < 0. 

From inequalities (6.6) and (6.7), we have that < Vr < min{r',r"}, 

P("'")(A:, 1) < P("'°)(A;,2) and P^''^)(A;, 4^=-^) - 1) > p("'")(fc, 4^"^)) 

hold, and thus 3i; G {3, 4, . . . , 4''"^^ - 1}, 

P("''^)(A;,1) < P("'")(A;,2) 

< • • • < P("'") (A;, 4 - 2) < P^"'"^) {k, 4 - 1) > P(""^) (A;, 4) 

> . . . > p(win) ^(fc-l) _ 1) > p{wm) -ik-i) ) ^ 



(fc-i) 

r ) • • • ) 



An optimal threshold strategy is attained by either Threshold(2*, i 
ii^^) or Threshold(i* — 1,4'^ ^\ . . . , ii^^) and thus i* — 1 < ir'^^ < i*. Clearly 
from Pr^"^^(/c,i* — 1) > p1™™^(/c, i*), index i* satisfies 

r{^l!'''^ ~^;)<l^ J2 (/"^^ (Sfc-i(O) • ' ' fHBiir))) • 

(&fc,...,&i)eHfc\{e} 
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From the above, we obtain that 



hm r(4'=-i) - z('=)) < hm r(4.'=-i) - (i^ - 1)) 
— >-+0 'I — >+0 



{bk,...M)es^\{e} 



= l-(l-Afc) = Afc. 

Since Fj^^^\k,i* - 2) < Pi^^^\k,i* - 1), index i* satisfies 

r(z('^-i) - K - 1)) > 1 - J2 {/'"-'iBk-iir)) ■ ■ ■ fHBiir))) • 

(6k,...,6i)eSfc\{e} 

Accordingly, we have that 

hm r|i?fc(r)| 

1 — >+o 

= lim r(4''-^) - 4'^)) > lim r(4''"^^ - K) 

■I — !-+0 ■! — !-+0 



''^ (bfc,...,bi)eHfc\{e} 



— 1 — (1 — Afc) — Afc, 
and thus lim r\Bi;(r) \ = Afc is obtained. 

r-i-+0 

Now, we have shown (6.1) and (6.2) for every k € {1,2, .. . ,m}, which 
implies 

lim P(^''^)(m) 

= .5?oE(( n M E (/'Hi?.(0)---/Ni?i(0) 

fc=l \ \ieBfc(r)U-UBi{r)/ \(fefc,...,fei)GHfc 

= .i-oElfn^''''^^^^') ( E (/'Hi^.(r-))---/^Hi?i(r-)) 

fc=l \\fc' = l / \(fefc,...,fei)G=fc 



k=i \ \k'=i / \(fefc,...,6i)eHfc ' / / fc=i 

where the last equality is obtained from (4.1). □ 
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7. Secretary Problem. In this section, we show that an optimal strat- 
egy for secretary problem attains our lower bounds obtained in Theorem 4.3. 
We discuss a sequence of 0/1 random variables X2 , , . . . , Xn satisfying 
Pr[Xj = 1] = for any i E {2, 3, . . . , N}. In the following, qi denotes the 
probability of failure 1 — and denotes the odds l/(i — 1) of Xj. 

Gilbert and Mosteller [13] showed that an optimal strategy for secre- 
tary problem with m-stoppings is attained by a threshold strategy. We 



denote an optimal threshold strategy by Threshold(i 



(m) .(m-l) 

N ' 'at 



1 ■ ■ ■ ,1'N 



which is dependent on the length A^. We also introduce a block partition 
{Bm+l{N),B„^{N), ...,Bi{N)} of index set {2, 3, ... , N} defined by 



BkiN) = { 



{i G {2,3,, 
{i G {2,3,, 
{i G {2,3,, 



.(fc) . .{k- 
<^<^P} 



.,N}\i)^> <i<N} 
.,N} I 
..,N} I 2 



1)1 



{1 < k < m), 
[k = m + 1). 



Lemma 7.1. Let (Ai, A2, • • • , Am) be a vector consisting of all positive en- 



tries. Assume that a threshold strategy Threshold(z 



(m) .(m— 1) 



' 'at J 



and 



a corresponding partition {Bm+i{N), Bm{N), . . . , Bi{N)} satisfy conditions 



(7.1) lim il^^ = -|-oo and lim ri = Xk, 

ieBk{N) 

for each k G {1,2, . . . ,m}. Then the partition also satisfies 
(7.2) 

\b 

lim TT <?i = e-^'= and V6 G {0, 1, . . . , m}, lim f\Bk{N)) = -t^, 
jgBfe(7V) 

/or eac/i G {1, 2, . . . , m}. 

Proof. Condition (7.1) directly implies limp^^oo 1" -w = 0. It is easy to 
see that 

In II Qi = M1-1A)= E (M^-l)-lni) 

.(fc) _ . 

(7.3) = - 1) - ln(.SJ-^) - 1) = In 

% -1 



and 

E 7^ in(zr)-i)-in(zs;)-i) > 1, 



.(fc-i)_^ .(fe-l)_2 
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where denotes + 1. From the above, we obtam that 

(fc-i)_ 

hm > Ti> — Um hi II Qi > hm > 

hm y fi > — hm In | | Qi > hm ( —r.ik) + > 



-Afc < lim In TT < -A, 



Accordingly, we have hmAr^oo lli(zB^{N) % = e 

We omit the case of f^{Bk{N)) in the fohowing, since equahty f^{Bk{N)) = 

1=0^ holds permanently. We discuss cases b £ {1,2,..., m}. The size of 
block Bk{N) satisfies the following; 



i(fe-i)_i 



lim \Bic{N)\r.(k) > lim rj = lim > ri = \k > 0. 

The positivity of implies limAr^oo \Bk{N)\ = +oo. There exists an inte- 
ger N' such that for any integer > N' , the size of Bk{N) exceeds m and 
thus 

V6G{l,2,...,m}, f\Bk{N))= ^ ( H ^0 ' 

B'CBk(N), \B'\=b ViGB' / 

Now, we show limTv-i-oo f {Bk{N)) = -jf by induction on b. Condition (7.1) 
directly implies the case 6=1, i.e., the equality 



hm fHBk{N)) = hm = ^ 

ieBkiN) 

■^b-l 

holds. Next, assume that limAr^i^oo f^~^{Bk{N)) = jj^^rrjt- Then, it is easy to 
see that 

hm f{Bk{N)) 

iV->oo 

N^oo ^ I J-i - N^oo bl b\ 

B'CBk{N), \B'\=b \i&B' / 
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k 



The induction hypothesis on b imphes that 

hm /(Sfc(iV)) = hm J2 (n^O 

B'CBkiN), \B'\=b \ieB' / 

^ f~HB,{N)){E.eBUN)r^-br^i^^) X^-' A, A 

> lim — — = — = — . 

- TV^oo b {b-l)\ b b\ 

Thus, we have shown hm7v-s>oo f {Bk{N)) = -jf . □ 

Following theorem gives the win probability of secretary problem. 

Theorem 7.2. Let (Ai, A2, • • • , Am) be a unique solution of (4.1). Given 
a sequence of 0/1 random variables X2,X3, . . . ,Xn satisfying Pr[Xi = 1] = 
l/i i^i G {2, 3, . . . , N}), the probability of win pjy ^ (m) of an optimal strat- 
egy for secretary problem with m-stoppings defined on X2, X^, . . . , Xj^ sat- 
isfies 

m 

lim p("'°Vm) =ye-S''=i^^'. 
k=l 

Proof. It is well-known that an optimal strategy for secretary problem 
with m-stoppings is attained by an optimal threshold strategy Threshold(i^^ , 
^\...,i^^^) satisfying that for any k S {l,2,...,m}, Threshold(ij^"\ 
^\ . . . , i^^^) is also an optimal strategy for fc-stopping problem. 
Here, we show property (7.1) in Lemma 7.1 by induction on k (which 
implies (7.2), simultaneously). When A; = 1, Threshold(z^^) is optimal to 
single-stopping problem. A classical theorem of secretary problem (see [10] 
and/or Sum the Odds Theorem [6]) implies that when N is sufficiently large, 



JV 



(7.4) 



i< Yl '''<i + ^ 



JV 



and thus 



1 > lim 




N N-1 ^ 

lim y ri= lim > — 



TV-i-oo 



> lim m —7— . 

■N 
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From the above, we obtain limjv_^oo ^jv^ = +00. Inequalities (7.4) directly 
implies 

N 

lim 1 < lim > < lim ( 1 + r.(i) ) 

'—'at 

^ / 1 \ 
1 < lim "S^ ri < lim 1 + ^-r = 1 

N^oo ^ N->-oo \ A^) 1 / 

i—ij^ 

and thus liTo.N^ooYjiaBAm'^i = limA^-^oo '"i = 1 = Ai. We have 

shown property (7.1) and obtained (7.2), when k = 1. 

Now, we describe fc-th induction step (where k < m) under the assump- 
tion that for any k' & {1,2, . . . , k — 1}, 



limiS^'^ = +oo and V6 € {0, 1, . . . , m}, lim /(Sfc/(iV)) = 



Let e be a unit A;-vector (1,0,0,... ,0). Lemma 4.1 says that e € and 
every vector (6^, . . . , 61) G \ {e} satisfies bk = 0. Obviously, we have 

(/^Hi?fc(iV))/'"=-^(i?fe-i(iV)) • • • f'^B.iN))] 

(6fe,...,fei)G=fe 

ieBk{N) (bfc,...,6i)eSfc\{e} 

Similarly to the proof of equality (6.5), the induction hypothesis (7.5) and 
the definition of equality system (4.1) imply 



Now we introduce a threshold strategy Threshold(i, ^jv • • • ' ^tv^) 

(Vi G {1,2, ... ^^}) for fc-stopping problem and employ a one-stage look- 
ahead approach [1]. We denote a probability of win of threshold strategy 
Threshold(i, ij^ ^^^7V • • • j^tv^) by P^™'*(A;,i). A difference of a pair of 
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win probabilities P^^^^\k,i — 1) and P^^^^\k,i) satisfies 



/ N 

n * 

/ AT 



' N 



N 



,(win)^ 



^ (r-^(B,_i(7V))....^(SiW)) 
.fc,...,&i)eHfc\{e} 



i'—i—l 

E ^''+ E (A-(Sfc-i(iv))---/''KBiW)) 

(6fc,...,&i)eSfc\{e} 
j(fc-i)_l \ 

- 1) ^ rj/ + qi^m^i 
(bfc,...,bi)GHA{e} 



- E "^' + 1 

\ (bfe,...,bi)eHfc\{e} 



From the above, it is easy to see that P^;^'''\k, i - 1) - pS7'°^(A:, i) is strictly 
increasing with i and a sequence of win probabilities 



{P^r\k,2),P^ 



is unimodal. In a similar way with a discussion about (6.6) in the proof of 
Theorem 6.2, we can show that there exists a large integer N' satisfying 

' T^Cwin),!, _ _ p{^-)(A;,i(J-l)) > 0. 



viv>iv', pr^(fc,i^ 

J (win) 



AT ^"-5 'AT 

Next, we consider the pair Py^'"''(A:, 2) and pj^™^(A;,3). The induction hy- 



pothesis (7.5) implies limAr^oo Z^i=3 " = +oo. Consequently, it is clear 
that 



N 



}™.|- E ^^' + 1- E {.f''-HBk-im---f'HBdN))) 

(6fc,...,bi)GHA{e} 



i'=3 



and thus there exists a large integer N" satisfying 

ViV > N", Pj;'") (fc, 2) - P;;'°) (fc, 3) < 0. 
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From the above, we have shown that VA^ > max{A^', N"} 



AT {k,i^ ), 



1 ft"- 

which imphes that there exists an index E {4, 5, . . . , i)^ 



1} satisfying 



<■■■< F^r\k,i*^ - 2)< PS;^'^)(fe,z^ - 1) > P^rHk^N) 



> ••• > p 



.(fc-1) 



An optimal threshold strategy is attained by either Threshold(i^, z]^ , 

* _ 1 ^ 

N — '■N 

1) > p'-^'^\k,i*^), index 



or Threshold(i^ — . . . , and thus i% — 1 < il^^ < 



j{wm) , 



Clearly from the inequality P^ v"-, '■at 
satisfies 



(f)fc,...,f)i)eHfc\{e} 
From the above, we obtain 



Afc = lim I 1 

JV->oo 



{bk....M)eEk\{e} 



> lim 

N^oo 



E 



1 



r,:' I = lim 



y 4 > lim In ^ 



?■* — 1 



The above inequality, the induction hypothesis (7.5) (limjv_>.oo i 
and inequality i^^^ > i^f — I directly imply 



(fc-i) 

N 



+00 ) 



lim = +0O and lim i^!^? = +oo. 



Additionally, we have that 



(fc-i) 



1 



lim > r,;/ < lim > 



. — ^i' = lim 



< lim 



1- E {f'''-'iB,-iiN))---f''HBi{N))) 

(bfc,...,6i)eHfc\{e} 



l-(l-Afc) = Afc. 
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Since pj^™^(A:,i|^ — 2) < P^^^^\k,i*j^ — 1), index satisfies 

(6fc,...,6i)eHfc\{e} 

Consequently, we have 
lim > r,7 > lim > r,-/ = lim — r,* _i + > r,-/ 

^ l^^ + l- E (/'''-(i?.-i(iV))---/''HBi(iV))) 

V ^ {b,,...M)es,\{e} 
= l-(l-Afc) = Afc. 



Prom the above, we obtain hmjv_^oo J2ieBh{N) ^« ~ -^fc- ^o^) have shown (7.1) 
and (7.2) for each A; € {1, 2, ... , m}. 

The probability of win pj,^™^ (m) satisfies 
lim P("'"V) 

= ri^^tii n E (/'Hi^.(iv))---/Ni3i(iv)) 

k=l \ \ieBk{N)U-UBiiN) / \{bk,...M)eEk 



fc=i \ \fc'=i / \(6fe,...,6i)eSfe 1 W/ fc=i 



where the last equality is obtained from (4.1). □ 

Lastly, we show a relation between threshold values and the probability 
of win of secretary problem indicated by Gilbert and Mosteller [13]. 

Theorem 7.3. Given a sequence of 0/1 random variables X2, X3, . . . , X]sf 
satisfying Pr[Xj = 1] = 1/i (Vi € {2, 3, . . . , iV}), an optimal (threshold) 
strategy Threshold(i^^ , ^\ . . . , ) for secretary problem with m-stoppings 
satisfies 

m .{k) 

lim y'j^= lim PS;'°)(m) 
k=l 

where P^"^ (?n) denotes a corresponding probability of win. 



40 T. MATSUI AND K. ANO 

Proof. In the following, ij^^ denotes + 1 and (Ai, A2, • • • , Am) denotes 
a unique solution of (4.1). Properties (7.1) and (7.2) shown in the proof of 
Theorem 7.2, and equality (7.3) imply that for any k G {1, 2, . . . , m}, 

.(fc) 

hm In 




+ ln ( ^ + -^^ 1 I = -Afc. 



Thus, we have 

Ah) 
'■N 

N^oo N N-yoo 



lim In = lim In 




and 



■ (k) 

lim — = e~'^h'=i^k' 



The above equality and Theorem 7.2 implies 

m .(k) m 

lim y'jL = ye-^y=ih'= lim PS;'°^(m). 

k=l k=l 



□ 
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